HIERARCHICAL SOLUTIONS FOR LINEAR EQUATIONS: 
A CONSTRUCTIVE PROOF OF THE CLOSED RANGE THEOREM 
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Abstract. We construct uniformly bounded solutions for the equations divU = f and curl U ~ fin 
the critical cases / e L^(r',M) and f e L^(R\K^). Bourgain & Brezis, [BB03, BB07], have shown that 
there exists no linear construction for such solutions. Our constructions are special cases of a general 
framework for solving linear equations of the form — f, where ^ is a linear operator densely 
defined in Banach space B with a closed range in a (proper subspace) of Lebesgue space L^(i2), and with 
an injective dual The solutions are realized in terms of a multiscale hierarchical representation, 
U = L7=i U;, interesting for its own sake. Here, the uj's are constructed recursively as minimizers of the 
iterative refinement step, u^+i = arginf„{ ||u||b + A;+i \\rj — ^u||^pj^j}, where rj := / — Ujt), 
are resolved in terms of an exponentially increasing sequence of scales Ay+i := Ai^A The resulting 
hierarchical decompositions, U = L7=i ^y, are nonlinear 
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1. Introduction and statement of the main results 

We begin with a prototype example for the class of equations alluded to in the title of the paper. 
Let L^(T'^) denote the Lebesgue space of periodic functions with zero mean over the J-dimensional 
torus T^. Given /gL^(T'^), we seek a uniformly bounded solution, U G L°°(T'^,M'^), of the problem 

(1.1a) divU = f, [/ gL^(T'^,M'0- 
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A classical solution is given by ?7 = VA which in addition to (1.1a), satisfies the irotationality 
constraint, 

(1.1b) curlU = 0. 

Clearly, this solution lies in W^(L^). But since W^{L^) is not contained in L°°, the solution may 
— and in fact does fail to satisfy the uniform bound sought for the solution of (1.1a), [BB03, §3, 
Remark 7]. Thus, the question is whether (1.1a) admits a uniformly bounded solution by giving 
up on the additional constraint of irotationality (1.1b). The existence of such solutions was proved 
by Bourgain and Brezis, [BB03, Proposition 1] using a straightforward but non-constructive duality 
argument based on the closed range theorem. We present here another duality-based approach for the 
existence of such solutions. Our approach is constructive: the solution U is constructed as the sum, 
U = Lu;, where the {u^ j's are computed recursively as appropriate minimizers, 

u^-+i =arginf|||u||L'» + Ai2^||/-rfjv( J^Uyfe) -c^jvu||^d|, ; = 0, 1,..., 
" ^ k=l 

and Xi is a sufficiently large parameter specified below. 

This construction is in fact a special case of our main result which applies to general linear problems 
of the form 

(1.2) ^u = f, feLP{a), iicK^, i<p<oo. 

Here, J2f : B i-> L^{^) is a linear operator densely defined on a Banach space B with a closed range 
in L^(fi). The subscript {•}# indicates an appropriate subspace of LP, 

LP{Q.)=LP{Q.)nKer{^), 

where ^ : i— 7> is a linear operator whose null is "compatible" with the range of ^ so that the 
dual of .if is injective, namely, there exists /3 > such that 

(1.3) \\g-^*g\y<^\\^*g\\M*, ygeLP'i^). 

The closed range theorem tells us that equation (1.2) has a bounded solution, U eM. Our main result 
is a constructive proof for the existence of such solutions in this setup. 

Theorem 1.1. Assume that the apriori estimate (1 .3) holds. Then, for any given f e L^{Q.), I < p <oo, 
equation (1.2) admits a solution of the form U = L7=i ^ ®' 



(1-4) l|t/||B^j8||/||LP, 

where the {uj} 's are constructed recursively as minimizers of 

j 

(1.5) U;+i = arginf{||u||B + A^-+i||o--^u||Jp}: H '■= f - ^iY^^k), 7 = 0,1,.... 
" k=i 

Here, {Xj}j>i can be taken as any exponentially increasing sequence, Xj+i :— Ai^-', _/ = 0, 1, . . . with 

sufficiency large X ^ 



1 ^ 



p-V 
LP 
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Remark 1.1. The description of U as the sum C/ = Luj provides a multiscale hierarchical decom- 
position of a solution for (1.2). The role {A^ j's as the different scales associated with the u/s, is 
realized in terms of the "energy bound" 



(1.6) LttKIIb^sjSII/IIl., /eL^(n), Ay+i = AiCA 

/•=i ^ 



1 

7=1 

The particular choice of dyadic scales, C, = 2^~\ for example, yields the specific B-bound in (1.4), 
(l-V) l|f/||B<^||/||L., U=Y^uj, Vi = ^i-— ; = 0,1,.... 

P j=i WjWlp 

The main novelty of theorem 1.1 is a constructive proof of the closed range theorem for operators 
with a closed range in L^, 1 < p < oo. The proof of the special case p = 2 is given in section 2: here, we 
trace precise bounds and clarify their role in the hierarchical construction. The L^-case serves as the 
prototype case for the general setup of hierarchical constructions in Orlicz spaces, outlined in section 
3. The general L^-case is then deduced in section 4. Finally, the characterization of minimizers, such 
as those encountered in (1.5), is summarized in section 5. 

L^-based hierarchical decompositions were introduced by us in the context of image processing, 
[TNV04], and we realize that their construction in the more general context of the closed range 
theorem could be useful in many applications. We demonstrate the hierarchical constructions in two 
important examples recently studied by Bourgain & Brezis, [BB03, BB07]. 

1.1. Bounded solutions of div U = fEL^. Let ^ denote the zero averaging proj ection, ■.= g—g 
where g is the average value of g. Given / G ^#(T'^) := {g e L^(T^) | g = O}, then according to 
theorem 1.1, we can construct hierarchical solutions of 

(1.8) divU = f, /eL^(T^), l<p<oo, 

in an appropriate Banach space, f/ e B, provided the corresponding apriori estimate (1.3) holds, 
namely, there exists a constant j8 > (which may vary of course, depending on p,d and B), such that 

(1.9) \\g-g\\iy<mgh*, VgeL^'(T^). 
We specify four cases of such relevant B's. 

#1. Solutions of (1.8) in W^'P. Since 

\\8-8\\u''{Td) < \\yg\\w-hp'{Td,Rdy Vg eL'''(T^), 

we can construct hierarchical solutions of (1.8) in B = W^'^(T^,R'^), I < p < oo. This is the same 
integrability space of the irrotational solution of (1.8), VA~^/ e W^'^(T^,] 



Remark 1.2. The -valued hierarchical constructions in theorem 1.1 is derived from a more general 

result of operators valued in Orlicz spaces, L*, associated with proper A'^-function This is carried 
out in our main theorem 3.2 below, under the assumption that (3.13) holds. The end cases p = l,oo 
are excluded from theorem 1.1 since the corresponding L^-spaces are not associated with proper N- 
functions and the closure assumption (3.13) fails. Observe that the end cases p= l,oo do not admit 
W^^P solutions for divU = feLP, [BB03, Section 2], [DFT05]. Instead, theorem 3.2 suggests that 
the corresponding end cases apply to critical L(logL) and exp(L) spaces, but we shall not pursue this 
here. 
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#2. Solutions of (1.8) in LP* . By Sobolev inequality 

(1.10) \\g-g\\i,'^^,^<Wg\W^^,^,y J^=\~-d^ d<p<^, WgELP'iT'), 

where the case = J corresponds to the is the Sobolev-Nirenberg inequality, gH^^d'cj-d) < jS|kllvi^i,i(T'')- 
We distinguish between two cases. 

(i) The case J < /? < oo: the equation divU = / G L^{T') has a solution U G LP* {T' ,M.''). This is 
the same integrability space of the irrotational solution VA^^f G W^^p{1:'',W') c L^*(T^,M'^). The 
hierarchical construction of U provides different solutions which are not necessarily irrotational. 

(ii) The case d = p: the equation divU = / G Lj{T'') has a solution U G L°°(T^,M^). This is the 
the prototype example discussed in the beginning of the introduction. According to the intriguing 
observation of Bourgain & Brezis, [BB03, Proposition 2], there exists no bounded right inverse K : 

1-^ L°° for the operator div, and therefore, there exists no linear construction of solutions f ^ U 
(in particular, VA~^/ cannot be uniformly bounded). Theorem 1.1 provides a nonlinear hierarchical 
construction of such solutions. 

Remark 1.3. We rewrite the hierarchical iteration (1.5) with Ai = Cj8 in the form 

Observe that if [ui,ri] is the first minimizer associated with tq = /, then the corresponding first 
minimizer associated with af is [aui,ari], and recursively, the next hierarchical components are 
[ocuy, drj]. Thus, as noted in [TNV08, remark 1.1], the hierarchical decomposition is homogeneous of 
degree one: if we let = Uy [/] specify the nonlinear /-dependence of the hierarchical componenets 
on /, then u j [af] = avij [/] . 

#3. Solutions of (1.8) in L"" n H'^ '^^ A central question raised and answered in [BB03] is whether 
(1.8) has a solution which captures the joint regularity, U G B = L°° n W^'^iT^^, W'-). To this end, one 
needs to verify the duality estimate (1.9), which now reads 

(1-11) \\g-g\\Ld'{Td)^H'^s\\o+w-^-d'(T'M.dV ^g^L'^' {T'^). 

This key estimate was proved in [BB03, Section 1.7]. A generalization with explicit constants was 
proved by Maz'ya in [Ma07]. Thus, theorem 1.1 converts (1.11) into a constructive proof of: 

Corollary 1.2. The equation divU = / G Ul{T'^) admits a solution U eU° nW^-'^{T^, W^), given by 
the hierarchical decomposition U — L;=i Uy, which is constructed by the refinement step, 

= argmf | ||u||^ocnvi/i.<i + Ai C'' ||/ - div ( u^) - div\x\\la | , j = 0, 1, 2 . . . , 

withi;> 1 andXx > j8||/||j./. 

Remark 1.4. The proof of the key estimate (1.11) by Bourgain & Brezis is in fact a by product of 
iheix construction of L°°C\W^'^ solutions for <i/v?7 = /, [BB03, theorem 1]. The construction, which is 
based on Littlewood-Paley decomposition, is rather involved. Corollary 1 .2 offers a simpler construc- 
tion of such solutions, which could be implemented in actual computations, based on the construction 
ofminimizersfor, y div{r,l\L^ ,Lf) :=inf„{||u||Loc + A||r- Jjvu||^J, [GLMV07, LV05]. It would be 
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desirable to develop efficient algorithms to compute minimizers of Vdiv (r, A ; L°° n W , L^) ; spectral 
approximation of such minimizers was discussed in [Ma06]. 

#4. Solutions of (1.8) in L°° n Vvj ^'(^2). The above constructions of bounded solutions for (1.8) 
extends to the case of Lipschitz domains, CI c M^, see [BB03, section 7.2]. For future reference we 
state the following. 

Corollary 1.3. Given f e L'l{Q) := {/ e LP{Q) \ jQ^f{x)dx — O}, then the equationdivU = f admits 
a solution U e LTD Wq''^{Q., W^), such that 

It is given by the hierarchical decomposition, U — J^j=i uj, which is constructed by the refinement 
step, 

Uj+i = argmfi ||u||^^niyi.j(ji) + AiC-^||/-<ijV ( u;t) - J/vu||J^(^) i, 7 = 0,1,2..., 



k=i 



with C > I and Xi > PWfW'j^ay 

The bound on the hierarchical solution in (1.7) is not sharp: the existence of solution with an 
optimal bound, ||t/||B < Vj8' > j8, can be derived using Hahn-Banach theorem, which in 

turn can be used to obtain optimal (least) upper-bounds in the Sobolev inequality (1.10). This is 
carried out in section 4 below. As an example, we have the following sharp version of the Gagliardo- 
Nirenberg inequality. 

Corollary 1.4. Let Q.bea Lipschitz domain in M.^. The least upper-bound in the Gagliardo-Nirenberg 
inequality, \\g -gWLd' {a) ^ P\\8\\bv{£1)' is given by 



i8> 



\da\ 



Note that by the isoperimetric inequality, we conclude a uniform least upper- bound, j8 = l/{daj''), 
where cOd is the volume of the unit ball in M^, [Zi89, §2.7], [DPD02, CNV04]. 

1.2. Bounded solution of curl U = {eLl(R^,R^). Let L^ (K^ , ) denote the L^ -subspace of divergence- 
free 3 -vectors with zero mean. We seek solutions of 

(1.12) curlU = t, fe4(M^M3), 

in an appropriate Banach space, f/ G B. We appeal to the framework of hierarchical solutions in theo- 
rem 1.1, where : (R-^ , R-^ ) i— )■ (M^ , ) is the irrotational portion of Hodge decomposition with 
a dual, := VA^J/vg — g. According to theorem 1.1, we can construct hierarchical solutions, 
[/ G B of (1.12), provided (1.3) holds 

(1.13) ||g- =^*g||i3/2 < j8||cMr/g||B*, g G l3/2(r3,r3). 

Since ||g— =^*g||^3/2 ^ ||cM^^g|lvi/-i.3/2, we can construct hierarchical solutions of (1.12) in W^'^. 
This has the same integrability as the divergence-free solution of (1.12), (— A)^^cMr/f. A more in- 
tricate question is whether (1.12) admits a uniformly bounded solution, since such a solution cannot 
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be constructed by a linear procedure. These solutions were constructed by Bourgain and Brezis in 
[BB07, Corollary 8'], which in turn imply the key estimate, 

(1.14) ||g-=^*g|L3/2(R3,K3) <j8||cMr/g||^,+^_l,3/2(K3,M3), Vg G L^/^ (^3 ^ . divg = g = 0. 

Granted (1.14), theorem 1.1 offers a simpler alternative to the construction in [BB07] based on the 
following hierarchical decomposition. 

Corollary 1.5. The equation curlU = feLl{M?,'E?), admits a solution U e LrnW^'^CE?,^?), 

l|f^llL~nVV1.3(R3,R3) < /3||f||L3(R3,R3), 

which can be constructed by the (nonlinear) hierarchical expansion, U = Y^uj, 

Uj+i = arginf I ||u||^»n^i,3 +Xi^J\\f-curl ( u^) - curlu\\l^^s^^3) | , 7 = 0, 1, ... , 
with C,>\andX\> j8/||f||j3(R3^R3)- 

2. An example: hierarchical solution of divU = / e Z.|(T^) 
We begin our discussion on hierarchical constrictions with a two-dimensional prototype example 

of 

(2.1) divU = f, feLliT^). 

Our starting point for the construction of a uniformly bounded solution of (2.1), U e L°°(T^, R^), is a 
decomposition of /, 

(2.2a) f^divui + ri, f e :^ {g e L^T^) \ [ g{x)dx^O}, 

where [ui , ri] is a minimizing pair of the functional, 

(2.2b) [ui,ri] = arg inf { ||u||l~ + /li||r||j2 }• 

divu+r=f K ^ ) 

Here Ai is a fixed parameter at our disposal: if we choose Xi large enough, X\ > |. , then 

according to lemma 5.3 below, (2.2b) admits a minimizer, [ui, ri], satisfying, 

lkillwM = ^. 

To proceed we invoke the Gagliardo-Nirenberg isoperimetric inequality, which states that there exists 
j8 > (any j8 > 1/ \/4k will do, [Zi89, §2.7]), such that for all bounded variation g's with zero mean, 

(2.3) IklL^ <^lkllwi.i, g{x)dx = 
Since / has a zero mean so does the residual ri and (2.3) yields 

(2.4) l|n|L2<j8||ri||^^i,i = A. 
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We conclude that the residual ri e L|(T^), and we can therefore implement the same variational 

decomposition of / in (2.2), and use it to decompose ri with scale A = A2 > Ai = — — . This 

yields 

(2.5) ri=divu2 + r2, [u2,r2]=arg inf i ||u||l- + A2||r||?;2 k 

divu+r=ri >. J 

Combining (2.5) with (2.2a) we obtain / = divU2 + ^2, where U2 := ui + U2 is viewed as an im- 
proved approximate solution of (2.1) in the sense that it has a smaller residual r2, 

lk2|k2<^||r2|UM = ^. 

This process can be repeated: if rj e ^|(T^) is the residual at step j, then we decompose it 

(2.6a) rj = divUj+i + rj+i, 

where [uy+i, ry+i] is a minimizing pair of 

(2.6b) [u;+i,r^+i] =arg inf | ||u||l~ +/l^-+i||r||j2|, ; = 0,1,.... 

divu+r=rj L J 

For j = 0, the decomposition (2.6) is interpreted as (2.2a) by setting ro := /. Note that the recursive 
decomposition (2.6a) depends on the invariance of r/GL|(T2): if r/ has a zero mean then so does 
rj+i, and by (2.3) r^+i G L|(T^). The iterative process depends on a sequence of increasing scales, 
Ai < A2 < . . . Ay+i, which are yet to be determined. 

The telescoping sum of the first k steps in (2.6a) yields an improved approximate solution, := 

(2.7) f = divUk + rk, Wnh'^ < P\\rk\\w^A = i^^i^i fc=l,2,.... 

The key question is whether the U^s remain uniformly bounded, and it is here that we use the freedom 
in choosing the scaling parameters Xk'. comparing the minimizing pair [uy+i, ry+i] of (2.6b) with the 
trivial pair [u = 0, rj] implies, in view of (2.7), 

(2.8) ||u;-+i||l- + Vi|l0-+i||^2 < ?ij+i\\rj\\j2 < ^ fi^Xj+i 



7 = 1,2, 



We conclude that by choosing a sufficiently fast increasing X/s such that £y Ay+i ^ <<>°, then the 

approximate solutions Uk — LiUj form a Cauchy sequence in L°° whose limit, U = 'LT^j' satisfies 
the following. 

Theorem 2.1. Fix /3 such that (2.3) holds. Then, for any given f G L|(T^), there exists a uniformly 
bounded solution of (2.1), 

(2.9) divU=f, ||[/||z.~<2j8 11/11^2. 
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The solution U is given by U = L7=l where the {uj} 's are constructed recursively as minimizers 
of 

(2.10) [u,-+i,r,-+i]=arg inf {||u||i== + Ai2ir||2,|, ro:=/, = 

divu+r=rj L J 11/11^2 

Proof Set A/ = Ai2-/'"i,j = 1,2,..., then, \\Uk- UfWi^ < l^'', A:>£>1. Let i7 be the limit of the 
Cauchy sequence {U^} then Hi/y — i7||L~ + \\divUj — f\\i2 ^ 2"-' — )> 0, and since div has a closed graph 
on its domain D :— {ueLT : divu G L^(^2)}, it follows that divU — f. By (2.8) we have 

Here Ai > !. is a free parameter at our disposal: we choose Ai := jS/H/H^^i which by (2.3) is 

admissible, Ai = -tt-^ — > .. !. , and (2.9) follows. □ 

2||/||^i,i 

Remark 2.1. [Energy decomposition] A telescoping summation of the left inequality of (2.8) yields 



1 



2 



7=1 j 

setting Ay = j82-'~^/||/||^2, we conclude the "energy bound" 

(2.11) tw^\ML-<m\L2- 

In fact, a precise energy equality can be formulated in this case, using the characterization of the 
minimizing pair (consult theorem 5.1 below), 2(rj_|_i, Jivuy+i) = ||Uy_|_i by squaring the 

refinement step rj = rj+i + ^Uj+i we find 

IIO'IIl^ - lk7+illL2 = 2{rj+i,divuj+i) + \\divuj+i\\l2 = -^\\uj+i\\L- + \\divuj+i\\l2. 
A telescoping sum of the last equality yields 

Corollary 2.2. Let U — L7=i "7 ^ be a hierarchical solution ofdivU — f, f & L|(^^). Then 

-j^ 00 -j^ 00 

(2-12) ^ E E ll^^"^"y+l|l4(T2) = ll/lli2(T2) 

2.1. Oscillations and image processing. Bourgain and Brezis [BB03, Proposition 2] have shown 
that there exists no linear construction of solutions of (2.1) for general f G I?. Yet, for the 'slightly 
smaller' Lorenz space, L^ ' , we have 

VA-VeL"', /glJ^(t2). 

(we note in passing that L - is a limiting case for the linearity of f ^ U to survive the -based 
nonlinearity result argued in the proof of [BB03, propositoin 2]). Thus, the nonlinear aspect of con- 
structing hierarchical solutions for (2.1) becomes essential for highly oscillatory functions such that 
/ e (and in particular, / ^ BV{T'^)). Such /'s are encountered in image processing in the form 

of noise, texture, and blurry images, [Me02, BCM05]. Hierarchical decompositions in this context of 
images were introduced by us in [TNV04] and were found to be effective tools in image denoising. 



On the construction of hierarchical solutions for linear equations 



9 



image deblurring and image registration, [BCM05, LPSX06, PL07, TNV08]. Here, we are given a 
noisy and possibly blurry observed image, / = + r G L^(M^), and the purpose is to recover a 
faithful description of the underlying 'clean' image, U ~ "^^"/, by de-noising r and de-blurring 
^. The inverse "^-i"/ should be properly interpreted, say, in the smaller space BV(^) C L^(R^) 
which is known to be well-adapted to represent edges. The resulting inverse problem can solved by 
corresponding variational problem of [ROF92, CL95, CL97] 

(2.13) [u,r] =^gm^^{\\n\\Bv + ^r\\l2^^2^], 

which is a special case of Tikhonov-regularization, [TA77, Mo84, Mo93]. The (fiV,L^) -hierarchical 
decomposition corresponding to (2.13) reads, [TNV04, TNV08], 

m 

(2.14) f=^Vm, t/m=l^u,-, [u,-+i,o-+i]=arg inf {||u||fiv + Ai2^lk||j2}. 

The oscillatory nature of noise and texture in images was addressed by Y. Meyer who advocated, 
[Me02], to replace with the larger space of "images" G := {/ \divii = /,u e L°°}. The equation 
divu = f arises here with one-signed measure /'s, and its L°° solutions were characterized in [Me02, 
§1.14],[PT08]: the space G+ coincides with Morrey space M^{D.): 

M^{Q.) = {iie^\ [ dil<r, yBrCQ.}. 

J Bf 

For one-signed measure, M^{Q) coincides with Besov space B^^'°°. The corresponding Meyer's en- 
ergy functional then reads, [u, r] — ^ inf^ { l|u||BV'(n) + Ikll^ } J numerical simulations with 

this model are found in [VO04]. 

2.2. L^(T^)-bounds and //~^(T^)-compactness. Here is a simple application of theorem 3.2. Let 
feH~'^ (t2) be given. For arbitrary g e (T^) we have ^jg{^) G LjiJ^), and by theorem 3.2, there 
exist bounded Utj G Lr(T^), such that 

^1^^) = ^if/ii(^)+^2f7l2(^), 
= ^lf/2l(^)+^2t/22(^). 

Thus, expressed in terms of the Riesz transforms, Rj\j/{^) :— we have 

g=\{Un + U22) + \ {R\-R2) {Un - U22) +R1R2 {U12 + U21); 

Since — R\ and R1R2 agree up to rotation, we conclude that: every g E (T^) can be written as 
the sum 

geH\T^): g = Ui+RiR2U2, C/i,C/2 G L°°(t2). 
The last representation shows that although an (T^)-bound of / does not imply / G H~^{T^), then 
/ does belong to H ^ if / and its repeated Riesz transform, RiR2f, are -bounded. 

Corollary 2.3. The following bound holds 

(2.15) WfU-m - WfWLHT') + W^MLm- 

As an example, consider a family of divergence-free 2-vector fields, u^(?, •) G L^(T^,]R^), which 
are approximate solutions of two-dimensional incompressible Euler's equations. One is interested in 
their convergence to a proper weak solution, with no concentration effects, [DM87]. It was shown in 
[LNTOO] that {u^} converges to such a weak solution if the vorticity, (0^(?-) := (9iM2(^ •) — d2u\{t, •), 
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is compactly embedded in /f~^(T^). By corollary 2.3, -compactness holds if {RiR2C0^ {t , ■)} ^ 
l1(T2); consult [Ve92]. 

3. The general case: construction of hierarchical solutions for = feLf 
We turn our attention to the construction of hierarchical solutions for equations of the general form 

(3.1) ^u = f, feLfio.). 

A solution U is sought in a Banach space M :— {U : ||f/||B < °°}- The general framework, involving 
two linear operators, and 0^, is outlined below. 

The linear operator J5f is densely defined on B with a closed range in L* := L* nKer(,^) with 
appropriate ^ : ^ L*. Here, L* = L*(n) is an Orlicz function space associated with a N- 
function, ^) : R+ R+, satisfying the A2-condition, ^{2^) < 24>(<^), [AF03, §8],[BS88, §4.8], 

(3.2) jSf : B ^ L* := L*nKer(^), = {/ : [f]^ := < 

The Orlicz space L^, the dual of L*, is associated with the complementary A'^-function ^{s) = 
suptist — 4>(?)). Finally, we let ^* : M* denote the formal dual of =Sf, acting on with 

the natural pairing (effectively, is acting on :— L*^ nKer(^), since R{^*) is in the null of 

(^*g,u) = (g,^u), geL^ueB, 
and let II • ||b* denote the dual norm 

II^^IIb* :=sup^ — , geL^. 

3.1. Approximate solutions. We begin by constructing an approximate solution of (3. 1), ?7;i, : ~ 
/, such that the residual : = / — is driven to be small by a proper choice of a scaling param- 
eter X at our disposal. The approximate solution is obtained in terms of minimizers of the variational 

problem, 

(3.3) V^(/,A;B,4)):= inf | ||u||b + A[r]4> : u e B, r e L||. 
In theorem 5.1 below we show if A is chosen sufficiently large, 

^^Wk)¥-' .(/):= sg„(/)*'(|/|). 

then the Vj5f(/, A) -functional in (3.3) admits a minimizer, u = u;i^, such that the size of the residual, 
rx '■= f — ■^^X'' is dictated by the dual statement 

(3.5) ||^>(a)||B* = |. 

Fix the scale A =Ai > 1/||^*9(/)||b*. We construct an approximate solution, ^i/i pa/, U\ :=ui, 
where ui is a minimizer of V^^(/, Ai), 

(3.6) / = ^ui+ri, [ui,ri]=arg inf V^(/,Ai;B,4)) 

Borrowing the terminology from image processing we note that the corresponding residual r\ contains 
'small' features which were left out of ui. Of course, whatever is interpreted as 'small' features at a 
given Ai -scale, may contain significant features when viewed under a refined scale, say A2 > Ai. To 
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this end we assume that the residual ri e Lf so that we can repeat the V -decomposition of ri, this 
time at the refined scale A2: 

(3.7) ri=^U2 + r2, [u2, ri] = arg inf V^(ri, A2;B,<D). 

Combining (3.6) with (3.7) we arrive at a better two-scale representation of U given by U2 := ui + 
U2, as an improved approximate solution of =Sf C/2 ~ /• Features below scale A2 remain unresolved in 
U2, but the process can be continued by successive application of the refinement step, 

(3.8) rj^j!fuj+i+rj+i, [u^-+i,r^-+i] := arc inf V^(r^-, Ay+i;B,<I>), ; = 1,2,.... 

To enable this process we require that the residuals rj remain in Lf; thus, in view of the dual bound 
(3.5) we make the following closure assumption. 

Assumption 3.1. The following apriori bound holds: 

||=^>U)||b*<-^[^]* = / 4>(|g(^)|)rf^<oo, (p{g)^sgn{g)^'{\g\). 

Given a residual term rj E Lf, we consider the generic hierarchical step where [uy+i,rj+i] is con- 
structed as a minimizing pair of V^(rj, Aj+i). Since ||=Sf*(p(rj+i) = ^/^j+i then by assumption 
3.1, [ry+ijci) is finite; moreover, since rj and R{^) are in Ker(^) then, 

ry+i =ry-^u^+i GKer(^), 
and we conclude that rj+i &Lf. In this manner, the iteration step 

is well-defined on B x L*. After k such steps we have, 

(3.9) / = =^ui + ri = 

= ^Ui+^U2 + r2 = 



= =Sfui+=SfU2 + --- + -5fUfe + r;f 

We end up with a multiscale, hierarchical representation of an approximate solution of (3.1) C/^t 
Uj £ K such that ^U]^ = f. Here, the approximate equality = is interpreted as the convergence 
of the residuals, 

dictated by the sequence of scales, < < . . . < X]^, which is at our disposal. We summarize in the 
following theorem. 

Theorem 3.1. [Approximate solutions] Consider =Sf : B i-> and assume that the closure as- 

sumption (3.1) holds. Then the equation = f,f E Lf{Q.) admits an approximate solution, 
f/jt e B : ^Uk = f, such that the residual, r^ := f — S^U^, satisfy 

(3.10) ||^>(r^)||B* = f , rk:=f-^Uk. 

The approximate solution admits the hierarchical expansion, Uk = T!j=i ^j' where the Uj's are con- 
structed as minimizers, 

inf {||u||B + Ay+i[r]4,}, ro = / 
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and satisfy 

k 1 

(3.11) I,^hjh<[fW 

j=i 

Proof. Compare the minimizer [u^+i, ry+i] of V _5f (r^, A-y+i) with the trivial pair [u = 0,r^] which 
yields the key refinment estiamte 

(3.12) [o']«i> ^ y— ll"y+illB + [o'+i]*' ; = o,i,.... 

Observe that the last inequality holds for 7 = with ro = /. A telescoping summation of (3.12) yields 
(3.11): 

k J 

7=1 

3.2. From approximate to exact solutions. According to (3.12), \\Uk\\B < ^k[fW- Do the approx- 
imate solutions Uk remain uniformly bounded in B? to this end, we need to quantify the closure 
assumption 3.1. 

Assumption 3.2. There exists an increasing function l] : 1R+ i-> 1R+ satisfying 
(3.13a) r l^ds <oo, 

Js=0 5^ 

such that the following apriori bound holds: 

(3.13b) [g]*<T7(||jSf>(g)||B*), VgeL* (pig) = sgnig)^'i\g\)eL'^. 

Using (3.12) we find 

r j=o, 

where {Ay} is an increasing sequence of scales at our disposal. Setting = Xi^-'^K we conclude 
that the approximate solutions, Uk = Y!i is a Cauchy sequence whose limit, f/ = Ef u^-, satisfies the 
following. 

Theorem 3.2. Assume that (3.13) holds. Then, given f E L*(t2), there exists a solution of (3.1), 
= f. The solution U is given by the hierarchical decomposition, 

OQ 

(3.15a) U=Y,yij, 
where the {uj} 's are constructed recursively as minimizers of 

(3.15b) [uy+i,ry+i] =^^_inf^ {||u||B + AiC^[r]4. :ueB, reLf'}, ro:=/, C > 1, 
and the following M-bound holds 

/■i/CAi ri(s) 1 
(3.16) \\Uh^?ii[fW+ -V^*<°°' _ 

Jo T] '{[fM 



(3.14) 
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Proof. For simplicity, we consider the dyadic case, ^ = 2. The upper-bound (3.14) implies that 
{C4 — Ly=i U;} is a Cauchy sequence: 



17 



which is sufficiently small for ^ > £ 3> 1 large enough. Hence Uj has a limit, U — 'LJ=i U;, such that 
[^Uj — /]$ — > 0, and since JSf has a closed range, J^U = /. Moreover, the limit U satisfies 

°° / 1 \ /•1/2A1 17 Co) 

llt^llB < £ lluyllB < Ai2^r7 — ^ < Ai[/]$ + 4 / -V^*- 

j=i j=2 / JO s 

Here Ai is a free parameter at our disposal subject to (3.4): we choose Ai := C/r\~^ ([/]*) with a 
sufficiently large constant C so that (3.4) holds, 

^1 := . wr.i N > 



and the bound (3.16) follows. □ 

3.3. Energy decomposition. We consider Orlicz spaces, L* with a strictly convex N- function 

(3.17) 4)">jc>0. 

Starting with the basic refinement step rj = r^+i + -^u^+i we then find 

[r^]^ = j^^ (lO+i +^u,.+i|) > (4>(|o-+i|) + ((p(o-+i),^u,-+i) + |||^u,-+if ) 
By corollary 5.3, since [uy+i, r^+i] is a minimizer of V ^{rj,Xj+i) it is an extremal pair, namely, 

(3.18) (<p(o-+i),^uy+i) = {^*cp{rj+i),nj+i) = ^||u,.+i||b, 
and we end up with the following improved version of the key estimate (3.12), 

(3.19) [r^-[o.+i]<j.>^||u,-+i||B + |||i^u,-+i||2,^^). 
A telescoping sum of this improvement yields the following. 

Corollary 3.3. Let U = X)7=iU; eM be a hierarchical solution of J^U = /, / e L* outlined in 
theorem 3.2, subject to a strictly convex (3.17). Then 

I 00 I 00 „ 

(3.20) Xr^527^""^'"»+ 2^?jl'^"^-|'^^(^) - JL^^'-^'^'^-'- 

The last energy bound turns into a precise energy equality in quadratic case, when Lf —L^: arguing 
along the lines of corollary 2.2 we have 
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4. Hierarchical solutions for ££U = / e 
We focus our attention on the case where L* is the Lebesgue space LF^{£i), seeking solutions of 

(4.1) J5ff/ = /, f&LP{Q.), l</7<oo, 

in an appropriate Banach space f/ G B. According to theorem 3.2, equation (4.1) admits a solution 
?7 e B, provided assumption 3.2 holds, namely, there exists an appropriate r\ : R+ i-)- M_|_ such that, 

(4.2) ||g||^<T7(||^>(g)||B0, VgeL^, (p(g):=p-sgn(g)|gri, f^'^dsKoo. 
The following lemma provides a useful simplification of the closure assumption (4.2) for the L^-case. 

Lemma 4.1. Let =^ : L* i-)- L* with dual Assume that there exists j8 > such that the following 
apriori estimate holds, 

(4.3) \\g-B^*g\\^J,,<^\\^*gU*, WgeLP'i^), \<p<oo. 
Then assumption 3.2 is fulfilled with — nKer(l^) and Tip{s) ^ sp\ I < p <oo. 
Proof Fix g e LP{a). Then (p{g) = p ■ sgn(g) \g\P-'^ e Lp' (a) and since g e Ker(=^) we find 

/ \g\Pdx=- [ g(p{g)dx^- [ g((p(g)-^>(g))rf^<-|k||z/||(p(g)-<^^>U)|lz^'. 
Ja pJa pJa P 

The apriori estimate assumed in (4.3) yields 

(4.4) \\g\\g' < ^\\^*(p{g)\k*, WgeLP{a), 

and the closure estimate (4.2) follows with r]p{s) ~ 5^', 1 < p < oo. □ 

Remark 4.1. Observe that the proof of lemma 4.1 — and as a consequence, the proof of the main 
theorem 1.1 derived below, are limited to 1 < p < oo. The end cases p = l,oo are excluded since 
(3.13a) fails to hold for rj [s) ~ sP . This, in turn, is related to the fact that the scaling functions 4> of 
LP are not proper A/^-functions for p = 1 , oo. 

Remark 4.2. As an example with ^ = div and ^ denoting the zero averaging projection ^g = 
g — g, lemma 4. 1 implies a generalized Sobolev-Nirenberg inequality 

^ l|sgn(g)|g|^-'||u^M(T^), Vg e Li{T^). 

Proof of theorem 1.1. Granted (4.3), then by lemma 4.1, theorem 3.2 applies with ri{s) = rip{s) — 
sP , and (3.16) implies 

iit/iiB^Aiii/ii^+ sP-^ds<xi\\f\\Pj,+-^^-^^^j^. 

Choose Ai := C||/||^*-^~^-': according to (4.4), such a choice of Ai with a sufficiently large C satisfies 
the admissibility requirement (3.4), 



^-1 \\^*cp{f)\\M*' 

and the uniform bound (1.4) follows, ||f/||B ~ D 
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Since the above proof was deduced from the general main theorem 3.2, we did not keep track of 
the precise dependence on the constant /3 and it remains to verify the more precise bound asserted in 
(1.7), namely, by specifying A^+i — XiC,^ with C, — 2^"^ we have 

(4.5) ||C/||b < ^II/IIl., Ay+i = Ai2(^-i)^ Ai - ^ 



p ■ 



Proof of remark 1.1. We argue along the lines of theorem 2.1 which proves (4.5) in the case p = 
2. The extension for p > 2 is based on (4.4) and (3.10), which yield the basic iterative estimate 
corresponding to (2.8), 

1 P 

\\uj+i\\M + Xj+l\\rj+i\\fj, < ?ij+i\\rj\\fj„ \\rj\\^ < -||-^*<P(0-)||b* = 7=1,2,.... 

P P^j 

Setting Xj+i = Xi2^P-^^j implies. 



p- 



and we conclude 



\u\\lp < + 1^ IIu^IIlp 

y=2 



p ^ „ ^ p 



< Aill/llf, + Ar^ (^) I 27^ = Ai^ 11/11^ +Ar^2^ (^) . 

Finally, the choice of Ai = P/\\f\\^^ yields (4.5). □ 

The bound in (4.5) is not sharp: if JfU = f admits a solution such that \\U\\^ < j8 H/Hz/, then 
the apriori estimate (4.3) follows by a straightforward duality argument. A sharp form of the inverse 

implication, (4.3) H- ||f/||B < follows from an argument based on Hahn-Banach theorem 

(outlined below). It would be desirable to obtain such a solution by hierarchical constructions. As a 
consequence, one can derive sharp version for the Sobolev inequalities, which we demonstrate in the 
context of the Gagliardo-Nirenberg inequality (2.3) 

(4.6) \\fh^'^a)<P\\f\\Bvia). feLliO). 

What is the best (least) possible j8 for (4.6) to hold? we turn to the 

Proof of corollary 1.4. Let U denote the solution with the corresponding sharp bound 

divU = f, ||C/||L-<j8||/|L.(n). 

It follows that 

/ fdx= [ u-nds<\\u\\L--\da\<p\\f\\,^,^^^\da\. 

We now fix the extremal / = ln(-*) such that Jo^fdx = ||/||z,d(n)l<^^l^^^'; the last inequality then 
yields 

B > 1^ . 
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By the isoperimetric inequality we conclude 

where denotes the volume of the unit ball in M'^. □ 

Remark 4.3. That the upper bound on the right of (4.7) is sharp can be verified by the extremal 
/= ls(x) over balls, [DPD02, CNV04], 

II/IIl^'Vs) 1 

sup — 



j^ld^ ll/llw(s) ddiY 



The proof of corollary 1 .4 suggests that / = ln(-^^) is the extremal equalizer to obtain an ^2-dependent 
bound, such that inequality on the left of (4.7) becomes sharp. 



lL'''(f2) _ , 

Proof of the sharp bound (4.8). This is essentially due to Bourgain & Brezis. We reproduce here (a 
slight generalization of) their non-constructive proof in [BB03, proposition 1]: if (4.3) is holds then 
= f admits a solution with the following sharp bound 

(4.8) ||f/||B<j8'||/||z^, j8'>i8. 

Normalize = 1 and consider the two non-empty convex sets: the ball 

% := {u e B : ||u||b < Pe}, Pe := (1 + e)j8 > j8 

and C := {[/ e B : = /}. The claim is that Ejg^ nC 7^ and the desired estimate (4.8) then 
follows with sufficiently small e <^ 1. If not, Bp^dC = Q), and by Hahn-Banach there exists a non- 
trivial g* e LP' such that for some a e R+ 

(4.9a) (g*,u)<a, Vue% 

and 

(4.9b) {g*,U)>a, yUeC. 

IfVe Ker(^) then application of (4.9b) with U ^U±dV eC yields ±6{g*,V)> 0, or {g* , V) = 0; 
that is, g* e Ker(Jf )^ = R(^*) is of the form g* = ^*g for some g e D{^*) c Lp' . Now, by (4.9a) 

II *ii (^*'") ^ " 
||g ||b* = sup —r < 



l|u||B=|8e/2 ^£/2 ^£/2' 

and the apriori estimate assumed in (4.3) implies 

cc 

WgWrv' < j8||jSf*g||B* =j8||g*||B* < 



But this leads to a contradiction: pick U (which we recall is not empty) then (4.9b) implies, 
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5. An appendix on V j^-minimizers 

To study the hierarchical expansions (3.9), we characterize the minimizers of the V _5f-functionals 
(3.3) 

(5.1) [u,r] :=arg inf V:^(/,A;B,^>), V^(/, A;B,4)) := inf |||u||b + A[r]* : u e ij. 

Here ^ : B i-^ ^*(^) is densely defined into a subspace of Orlicz space over a Lipschitz domain Q. C 
W^. We shall often abbreviate V^(/, A) for V^(/, A;B,4>). The characterization summarized below 
extends related results which can be found in [Me02, Theorem 4], [ACM04, Chapterl], [TNV08, 
Theorem 2.3]. 

Recall that || • ||b* denotes the dual norm, ||^*g||B* = (=$f*g,u)/||u||B, so that the usual duality 
bound holds 

(5.2) {^*g,u) < ||u||B||=^*g||B*, g e L^, u e B. 

We say that u and JSf *g is an extremal pair if equality holds above. The theorem below characterizes 
[u, r] as a minimizer of the V ^-functional if and only if u and Jf*^{r) form an extremal pair. 

Theorem 5.1. Let ^ :M ^ Lf{Q) be a linear operator with dual ^* and let V_^{f,?i;M, 4>) denote 
the associated functional (3.3). 

(i) The variational problem (5.1) admits a minimizer u. Moreover, if || • ||b is uniformly convex, 

then a minimizer u with ||u||b 7^ unique. 

( ii) u is a minimizer of (5.1) if and only if the residual r:—f — satisfies 

(5.3) (=Sf>(r),u) = ||u||b • \\^Mr)h* = u e L* <p(r) := sgn{r)^' {\r\) e l"^ . 

Proof, (i) The existence of a minimizer for the V -functional follows from standard arguments which 
we omit, consult [AV94, Me02]. We address the issue of uniqueness. Assume ui and U2 are minimiz- 
ers with the corresponding residuals ri= f — ui aar2 = f — JSf U2 

||U;-||b + 'A = Vm,„, /=1,2 

We then end up with the one-parameter family of minimizers, ug := ui + 0(u2 — Ui), e [0, 1], 

Vmin < ||U0||b + >^[^0]* < 0||U2||b + (1 - 0)||ui||b + 0>^[^2]* + (1 - d)X,[ri]^ = Vmin- 

Consequently, [rQ],^ — 9[r2\(i> + (1 — and hence r\ — r2. In particular, [ri]<j> = [r2]<5 implies 

that the two minimizers satisfy ||ui||b = ||u2||b and we conclude that the ball ||u||b = ||ui||b 
contains the segment {ug, G [0, 1]}, which by uniform convexity, must be the trivial segment, i.e., 

U2 = Ui. 

(ii) If u is a minimizer of (5.1) then for any v e B we have 

(5.4) V^(u,A) = ||u||b + A[/-^u]$ 

< V^(u + ev, A) = ||u + ev||B + A [/ - J^(u + ev)]$ 

<||u||B + |e|-||v||B + A[/-^u]<i.-Ae(sgn(/-^u)4>'(|/-^u|),^v)+^(e2). 
It follows that for all v e B, 

(^>(r),v>|<i||v||B + ^(|e|), (p(r) = sgn(r)4>'(|r|), r:=/-^u, 
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and by letting e — > 





Conversely, we show that if (5.3) holds then u is a minimizer. The convexity of ^> yields 




#1 #2 



= [/-j2fu]4.- (=^>(r),(u + v)> + (jSf>(r),u>. 



By (5.3) ||j2f*<p(r)||B* = which implies 

-A(#l) > -||u + v||b and A(#2) = ||u||b. 
We conclude that for any v G B, 

V^(u + v,A) = ||u + v||B + A[/-=Sf(u + v)]<t > ||u + v||b + A[/-^u]c|,-A(#1)+A(#2) 

> ||u||b+A[/-^u]<i, = V^(u,A). 
Thus, u is a minimizer of (5. 1). □ 

Remark 5.1. A lack of uniqueness is demonstrated in an example of [Me02, pp. 40], using the t°- 
unit ball, which in turn lacks strict convexity. Thus, strict convexity is necessary and sufficient for 
uniqueness. 

The next two assertions are a refinement of Theorem 5.1, depending on the size of ||^*(p(/) ||b*. 
Lemma 5.2. [The case 

II^*9(/)I|b* < l/Ay. Let ^ -.M^ Lf{Q.) with adjoint if* and let V ^ 
denote the associated functional (3.3). Then X ||b* < 1 if and only if u = is a minimizer of 



which tells us that u = is a minimizer of (3.3). Conversely, if u = is a minimizer of (5.1), then 
e||u||B + A[/ - eifu]* > [/]<!> for all u e B. It follows that 



(5.1). 



Proof. Assume ||^*(p(/) ||b* < 1/A. Then by the convexity of ^> we have 





Letting e|0 we conclude A (=^*<j!)(/),u) < ||u||b, hence \\^*(p{f)\\w < lA- 



□ 
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Lemma 5.3. [The case ||^*^(/)||b* > l/X]. Let ^ : M ^ Lf{Q.) with adjoint ^* and let Vj^ 
denote the associated functional (3.3). If I < A||=Sf*9(/)||B* < °°, then u is a minimizer of (5.1) if 
and only if^u and ^(r) is an extremal pair and 

(5.6) II^>('-)||b* = \. (u,^>(r)) = 

Proof. Since ||=5f *^(/) ||b* > 1/A then ||u||b 7^ and we can now divide the equality on the right of 
(5.3) by ||u||b 7^ and (5.6) follows. □ 
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